"Seeing inside out": revealing the effectiveness of otoscopy training in virtual reality enhanced practical exams - a randomized controlled trial.

BACKGROUND: The study aimed to assess the impact of different training modalities on otoscopy performance during a practical exam using a high-fidelity simulator and to determine if objective evaluation of otoscopy is feasible using a simulator that records insertion depth and tympanic membrane coverage. METHODS: Participants were assigned to one of four groups: control and three intervention groups with varying training approaches. Participants received otoscopy training and then were assessed through a practical exam on a high-fidelity simulator that uses virtual reality to visualize the ear canal and middle ear. Performance was evaluated using a modified Objective Structured Assessment of Technical Skills checklist and Integrated Procedural Performance Instrument checklist. Insertion depth, tympanic membrane coverage, and correct diagnosis were recorded. Data were tested for normal distribution using the Shapiro-Wilk test. One-way ANOVA and, for non-normally distributed data, Kruskal-Wallis test combined with Dunn's test for multiple comparisons were used. Interrater reliability was assessed using Cohen's κ and Intraclass correlation coefficient. RESULTS: All groups rated their training sessions positively. Performance on the OSATS checklist was similar among groups. IPPI scores indicated comparable patient handling skills. The feedback group examined larger tympanic membrane areas and had higher rates of correct diagnosis. The correct insertion depth was rarely achieved by all participants. Interrater reliability for OSATS was strong. IPPI reliability showed good correlation. CONCLUSION: Regardless of training modality, participants perceived learning improvement and skill acquisition. Feedback improved examination performance, indicating simulator-guided training enhances skills. High-fidelity simulator usage in exams provides an objective assessment of performance.

Development and Validation of an Automated Classifier to Diagnose Acute Otitis Media in Children.

Importance: Acute otitis media (AOM) is a frequently diagnosed illness in children, yet the accuracy of diagnosis has been consistently low. Multiple neural networks have been developed to recognize the presence of AOM with limited clinical application. Objective: To develop and internally validate an artificial intelligence decision-support tool to interpret videos of the tympanic membrane and enhance accuracy in the diagnosis of AOM. Design, Setting, and Participants: This diagnostic study analyzed otoscopic videos of the tympanic membrane captured using a smartphone during outpatient clinic visits at 2 sites in Pennsylvania between 2018 and 2023. Eligible participants included children who presented for sick visits or wellness visits. Exposure: Otoscopic examination. Main Outcomes and Measures: Using the otoscopic videos that were annotated by validated otoscopists, a deep residual-recurrent neural network was trained to predict both features of the tympanic membrane and the diagnosis of AOM vs no AOM. The accuracy of this network was compared with a second network trained using a decision tree approach. A noise quality filter was also trained to prompt users that the video segment acquired may not be adequate for diagnostic purposes. Results: Using 1151 videos from 635 children (majority younger than 3 years of age), the deep residual-recurrent neural network had almost identical diagnostic accuracy as the decision tree network. The finalized deep residual-recurrent neural network algorithm classified tympanic membrane videos into AOM vs no AOM categories with a sensitivity of 93.8% (95% CI, 92.6%-95.0%) and specificity of 93.5% (95% CI, 92.8%-94.3%) and the decision tree model had a sensitivity of 93.7% (95% CI, 92.4%-94.9%) and specificity of 93.3% (92.5%-94.1%). Of the tympanic membrane features outputted, bulging of the TM most closely aligned with the predicted diagnosis; bulging was present in 230 of 230 cases (100%) in which the diagnosis was predicted to be AOM in the test set. Conclusions and Relevance: These findings suggest that given its high accuracy, the algorithm and medical-grade application that facilitates image acquisition and quality filtering could reasonably be used in primary care or acute care settings to aid with automated diagnosis of AOM and decisions regarding treatment.

Remote paediatric ear examination comparing video-otoscopy and still otoscopy clinician rated outcomes.

OBJECTIVE: Telemedicine, particularly real time video-otoscopy in rural and remote Australia holds great potential in assessing and managing otology conditions. There is good evidence of store and forward images for assessment, however limited evidence exists for the use of real-time video-otoscopy. The objective of this study was to assess the validity of using real time video-otoscopy, compared to standard store and forward still image otoscopy, in a paediatric population. METHOD: Fifty-two paediatric tympanic membranes in 27 patients were examined and photographed by a telehealth facilitator with prior otoscope training. This occurred at two rural Western Australian health centre sites. These images were stored and forwarded to a tertiary paediatric hospital for otolaryngology department assessment on the day of real-time video-otoscopy consultation. During this consultation the same twenty-seven patients underwent real-time video-otoscopy assessment, which was recorded. Across six domains including, image quality, focus, light, cerumen amount, field of view and tympanic membrane landmarks, real-time video-otoscopy was compared against still image capture. The recording of each real-time video-otoscopy and still image tympanic membrane was assessed by two otology specialists for the ability to diagnose each as either normal or abnormal. An inter-rater reliability agreement was then calculated. RESULTS: There was greater image adequacy across five of the six domains for real time video-otoscopy compared to standard store and forward otoscopy images. Substantial agreement in diagnosing each tympanic membrane as either normal or abnormal between each rater was evident. CONCLUSION: This study supports the use of real time video-otoscopy during telemedicine consultation. With greater image quality, focus, light, field of view and identification of tympanic membrane landmarks video-otoscopy compared to still images has broad clinical applications. This includes primary assessment of the tympanic membrane and post operative follow-up clinical settings. Video-otoscopy offers a promising new way to over-come barriers in delivering ear health care in rural populations.

Diagnostic accuracy of the video otoscope in tympanic membrane perforation.

OBJECTIVE: The video otoscope has already proven to be useful for the diagnosis of several pathologies, so the objective of this study was to evaluate the diagnostic accuracy of the video otoscope in cases of tympanic membrane perforation. METHODS: This is a diagnostic accuracy study performed at the hearing health division of a tertiary-level referral hospital. Patients older than 8 years of age who had any symptom that could be related to perforation (otalgia, otorrhea, tinnitus, and/or hypoacusis) were invited to participate in the study. Participants were evaluated by three different diagnostic methods (otomicroscope, conventional otoscope, and video otoscope) performed by three different evaluators in a blind fashion. The microscope was considered the reference standard. RESULTS: 176 patients were evaluated, totaling 352 tympanic membranes. Twenty-seven tympanic membrane perforations were diagnosed by the microscope, a prevalence of 7.7%. The video otoscope showed a sensitivity of 85.2% (95% CI 81.5%‒88.9%), specificity of 98.1% (95% CI 96.7%‒99.5%) and accuracy of 97.1% (95% CI 95.4 %-98.8 %). The conventional otoscope showed a sensitivity of 96.3% (95% CI 94.3-98.3), specificity of 98.8% (95% CI 97.7-99.9) and accuracy of 98.6% (95% CI 97.4-99.8). The Kappa value between the microscope and the video otoscope was 0.8 and between the microscope and the conventional otoscope was 0.9. Regarding the participants' perception, 53.4% (p< 0.001) considered the video otoscope as the best method for understanding the tympanic membrane condition presented by them. CONCLUSIONS: The video otoscope showed relevant sensitivity and specificity for clinical practice in the diagnosis of tympanic membrane perforation. Moreover, this is an equipment that can facilitate the patient's understanding of the otologic pathology presented by him/her. In this regard, this method may be important for better patient compliance, requiring further studies to evaluate this hypothesis. LEVEL OF EVIDENCE: Is this diagnostic or monitoring test accurate? (Diagnosis)-Level 2 (Individual cross-sectional studies with consistently applied reference standard and blinding).

Evaluating the generalizability of deep learning image classification algorithms to detect middle ear disease using otoscopy.

To evaluate the generalizability of artificial intelligence (AI) algorithms that use deep learning methods to identify middle ear disease from otoscopic images, between internal to external performance. 1842 otoscopic images were collected from three independent sources: (a) Van, Turkey, (b) Santiago, Chile, and (c) Ohio, USA. Diagnostic categories consisted of (i) normal or (ii) abnormal. Deep learning methods were used to develop models to evaluate internal and external performance, using area under the curve (AUC) estimates. A pooled assessment was performed by combining all cohorts together with fivefold cross validation. AI-otoscopy algorithms achieved high internal performance (mean AUC: 0.95, 95%CI: 0.80-1.00). However, performance was reduced when tested on external otoscopic images not used for training (mean AUC: 0.76, 95%CI: 0.61-0.91). Overall, external performance was significantly lower than internal performance (mean difference in AUC: -0.19, p ≤ 0.04). Combining cohorts achieved a substantial pooled performance (AUC: 0.96, standard error: 0.01). Internally applied algorithms for otoscopy performed well to identify middle ear disease from otoscopy images. However, external performance was reduced when applied to new test cohorts. Further efforts are required to explore data augmentation and pre-processing techniques that might improve external performance and develop a robust, generalizable algorithm for real-world clinical applications.

Clinician-rated quality of video otoscopy recordings and still images for the asynchronous assessment of middle-ear disease.

INTRODUCTION: Video otoscopy plays an important role in improving access to ear health services. This study investigated the clinician-rated quality of video otoscopy recordings and still images, and compared their suitability for asynchronous diagnosis of middle-ear disease. METHODS: Two hundred and eighty video otoscopy image-recording pairs were collected from 150 children (aged six months to 15 years) by an ear, nose, and throat (ENT) specialist, audiologists, and trained research assistants, and independently rated by an audiologist and ENT surgeon. On a five-point scale, clinicians rated the cerumen amount, field of view, quality, focus, light, and gave an overall rating, and asked whether they could make an accurate diagnosis for both still images and recordings. RESULTS: More video otoscopy recordings were rated as 'good' or 'excellent' compared to still images across all domains. The mean difference between the two otoscopic procedures ratings was significant across almost all domains (p < 0.05), except 'cerumen amount'. The suitability to make a diagnosis significantly improved when using recordings (p<0.05). Younger participant age was found to have a significant, negative impact on the ratings across all domains (p < 0.03). The role of the tester conducting video otoscopy did not have a significant impact on the ratings. DISCUSSION: Video otoscopy recordings were found to provide clearer views of the tympanic membrane and increase the ability to make diagnoses, compared to still images, for both audiologists and ENT surgeons. Research assistants with limited practice were able to obtain video otoscopy images and recordings that were comparable to the ones obtained by clinicians.

Smartphone-enabled otoscopy: method evaluation in clinical practice.

OBJECTIVE: To assess the diagnostic agreement between smartphone-enabled otoscopy and rigid otoendoscopy in tympanic membrane and middle ear diseases. METHODS: A cross-sectional study was carried out to analyze otoscopies in patients seen at a general otorhinolaryngology (ORL) outpatient clinic, from June to December 2019. Eighty-three images of patients obtained from otoscopies performed through a smartphone device and a rigid endoscope were included, recorded, and stored for further analysis. The images were first analyzed by an experienced otologist, who assigned his diagnostic impression (defined as the gold standard) on each of the images. After this analysis, the images were displayed to a group of secondary raters (an experienced otorhinolaryngologist, a second-year resident in ORL, and a general practitioner). A questionnaire was applied related to each image. RESULTS: There was high agreement between the smartphone device and the otoendoscopy images for all professionals, with a Kappa coefficient of 0.97 (p < 0.001). The smartphone device showed a diagnostic sensitivity of 81.1% and a specificity of 71.1%. As for the otoendoscopy, it showed a sensitivity of 84.7% and a specificity of 72.4%. The image classification as "2 = Good" was the most frequent one, with 34.9% for otoendoscopy and 31.6% for the smartphone device. CONCLUSION: There was a high diagnostic agreement between smartphone device-guided otoscopy and the rigid otoendoscopy, demonstrating the feasibility of using this device in clinical practice.

Machine Learning in Diagnosing Middle Ear Disorders Using Tympanic Membrane Images: A Meta-Analysis.

OBJECTIVE: To systematically evaluate the development of Machine Learning (ML) models and compare their diagnostic accuracy for the classification of Middle Ear Disorders (MED) using Tympanic Membrane (TM) images. METHODS: PubMed, EMBASE, CINAHL, and CENTRAL were searched up until November 30, 2021. Studies on the development of ML approaches for diagnosing MED using TM images were selected according to the inclusion criteria. PRISMA guidelines were followed with study design, analysis method, and outcomes extracted. Sensitivity, specificity, and area under the curve (AUC) were used to summarize the performance metrics of the meta-analysis. Risk of Bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool in combination with the Prediction Model Risk of Bias Assessment Tool. RESULTS: Sixteen studies were included, encompassing 20254 TM images (7025 normal TM and 13229 MED). The sample size ranged from 45 to 6066 per study. The accuracy of the 25 included ML approaches ranged from 76.00% to 98.26%. Eleven studies (68.8%) were rated as having a low risk of bias, with the reference standard as the major domain of high risk of bias (37.5%). Sensitivity and specificity were 93% (95% CI, 90%-95%) and 85% (95% CI, 82%-88%), respectively. The AUC of total TM images was 94% (95% CI, 91%-96%). The greater AUC was found using otoendoscopic images than otoscopic images. CONCLUSIONS: ML approaches perform robustly in distinguishing between normal ears and MED, however, it is proposed that a standardized TM image acquisition and annotation protocol should be developed. LEVEL OF EVIDENCE: NA Laryngoscope, 133:732-741, 2023.

Comparative validity of three simulation platforms for objective assessment of otoscopy skills.

OBJECTIVES: To assess the face, construct and content validity of three different platforms for otoscopy skills assessment, using a traditional otoscope with manikin, digital otoscope (Tympahealth) with manikin, and traditional otoscope with a low-cost model ear (SimEar). DESIGN: Prospective mixed methods study. SETTING: Tertiary hospital. PARTICIPANTS: Postgraduate trainees and expert assessors. MAIN OUTCOME MEASURES: Face and Content validity based on expert assessor ranking on each model and their feedback from semi-structured interviews. Construct validity based on Objective Structured Clinical Examination scores. RESULTS: Each platform differed in face, construct and content validity scores, with no one platform consistently outperforming others. Three main themes were identified during thematic analysis of expert assessor interviews: ability to assess what is seen, anatomical reality, and ease of use. The low-cost model showed greatest potential, where modification to include a silicone ear could lead to high validity with marginal increase in cost. CONCLUSION: Several modalities for assessing otoscopy skills exist, each with advantages and disadvantages. Modifications to a low-cost model, for use with either a traditional or digital otoscope, could prove to be the best model.

Improving otoscopy education and diagnostic accuracy: A prospective interventional study.

OBJECTIVE: To assess and improve otoscopy examination skills across various medical specialities who perform otoscopy during their professional practice. METHODS: A pre-intervention survey was created using www.surveymonkey.com, which included several preliminary questions to clarify the participant's speciality and training level, followed by 25 individual otoscopy images. The participants were given 12 possible diagnoses for each otoscopy image and asked to choose the single best answer. After completing the survey, participants were asked to watch an otoscopy teaching session. This teaching session was created with multidisciplinary feedback, and the content included a demonstration video and a didactic lecture. Finally, a post-intervention survey was circulated four weeks later to the same cohort of doctors to assess improvement. RESULTS: A total of 79 pre-intervention surveys were collected with an average score of 53% (range 20-100%). The spectrum of medical specialities that completed the pre-intervention survey included paediatrics, ear, nose, and throat (ENT), emergency medicine, and general practice. The largest cohort of surveys came from senior house officers (SHO). In addition, 78.5% of responses were completed by doctors who had not worked in ENT before. After completing the otoscopy teaching session and at least four weeks after the initial survey, 23 post-intervention surveys were completed with an average score of 66% (range 32-100%), a 13% improvement. CONCLUSIONS: The results of the pre-intervention survey show that many doctors have difficulty diagnosing ear conditions. The implementation of a 25-min teaching session achieved a 13% improvement in the otoscopy knowledge of doctors across a variety of specialities.

Artificial intelligence and tele-otoscopy: A window into the future of pediatric otology.

Telehealth in otolaryngology is gaining popularity as a potential tool for increased access for rural populations, decreased specialist wait times, and overall savings to the healthcare system. The adoption of telehealth has been dramatically increased by the COVID-19 pandemic limiting patients' physical access to hospitals and clinics. One of the key challenges to telehealth in general otolaryngology and otology specifically is the limited physical examination possible on the ear canal and middle ear. This is compounded in pediatric populations who commonly present with middle ear pathologies which can be challenging to diagnose even in the clinic. To address this need, various otoscopes have been designed to allow patients, their parents, or primary care providers to image the tympanic membrane and middle ear, and send data to otolaryngologists for review. Furthermore, the ability of these devices to capture images in digital format has opened the possibility of using artificial intelligence for quick and reliable diagnostic workup. In this manuscript, we provide a concise review of the literature regarding the efficacy of remote otoscopy, as well as recent efforts on the use of artificial intelligence in aiding otologic diagnoses.

Evaluating the inclusion of tympanometry in population-based surveys of hearing loss.

OBJECTIVE: This study aimed to determine the implications of including tympanometry in the Rapid Assessment of Hearing Loss survey protocol. A comparative study design was employed, with findings from otoscopy compared with the results of tympanometry. METHOD: A population-based survey of the prevalence and causes of hearing loss among adults aged over 35 years in The Gambia was conducted. Clinical assessments included air conduction audiometry, otoscopy and clinical history. Otoscopy outcome was recorded and for those with hearing loss, a probable cause was assigned. Following otoscopy, tympanometry was completed. Otoscopy outcome was not changed as a result of tympanometry. Clinician assigned cause was compared to the results of tympanometry. The proportion of causes potentially misclassified by excluding tympanometry was determined. RESULTS: Among people with hearing loss, including tympanometry led to a higher proportion diagnosed with middle-ear conditions. CONCLUSION: The value of adding tympanometry to population-based survey protocols is a higher estimated proportion of hearing loss being attributed to middle-ear disease rather than sensorineural causes. This can inform service needs as more people will be classified as needing medical or surgical services, and a slightly lower number will need rehabilitative services, such as hearing assistive devices. It is highly recommended that tympanometry is included in the protocol.

Endoscopic ear examination improves self-reported confidence in ear examination skills among undergraduate medical students compared with handheld otoscopy.

Objectives: Handheld otoscopy is the standard tool used to teach ear examination in undergraduate and postgraduate medical education. Previous studies have shown that the undergraduate teaching of ear examination with handheld otoscopes is inadequate, resulting in low self-reported levels of student confidence in their diagnostic skills. With the increase in popularity of endoscopic ear surgery, an increasing number of otolaryngologists are using endoscopes for office examinations of the ear due to the method's superior visualization and excellent image qualities. However, medical students usually do not receive exposure to endoscopic ear examination during their undergraduate curriculum. The aim of this study is to assess our preliminary experience with teaching endoscopic ear examination to undergraduate medical students. Methods: A two-hour-long pilot practical course on basic ear examination was administered to undergraduate medical students with little to no previous experience with ear examination. The course was designed to minimize the duration of campus attendance and patient contact during the COVID-19 pandemic. The course included theoretical didactics, exemplary digital endoscopic images and peer physical practice of ear examination with both a handheld otoscope and a 0-degree endoscope. At the end of the course, the students completed a survey questionnaire consisting of eight questions mainly relating to their subjective confidence level with ear examination using either handheld otoscopes or endoscopes and their overall preference for either examination tool. Results: Most students expressed a preference for ear examination with endoscopes over that with handheld otoscopes and reported an improved confidence level in their diagnostic ability with the former technique. The vast majority of students supported the teaching of endoscopic ear examination to future medical students. Conclusion: The findings of this pilot project report and survey study support the early exposure of novice medical learners to endoscopic ear examination, which may help improve the confidence and diagnostic skill of medical students with regard to ear examination. The findings may have implications for the undergraduate teaching of ear examination in the post-COVID-19 era.

Bilateral cholesterol granulomas in the middle ear cavities of a cat with sinonasal disease successfully removed via video-otoscopy.

CASE DESCRIPTION: A 9-year-old spayed female Maine Coon cat was presented at the University of Veterinary Medicine Vienna for further investigation of chronic nonpruritic bilateral ear disease and unilateral Horner syndrome. CLINICAL FINDINGS: Physical examination and otoscopy findings included right sided Horner syndrome, a right head tilt of approximately 20° and a small pink nodule in the right and several smaller nodules in the left proximal horizontal external ear canal. Computed tomography and magnetic resonance imaging revealed soft tissue opacity material in both middle ear cavities, the caudal portion of the nasal cavity, the left nasopharyngeal meatus and the right frontal sinus. Via videootoscopy, 2 multilobular and several flat nodules were detected in the proximal right horizontal external ear canal and in the left tympanic bulla, respectively. Histopathological examination confirmed the diagnosis of cholesterol granulomas. TREATMENT AND OUTCOME: All otic cholesterol granulomas (CGs) were removed via video-otoscopy (VO), and topical treatment was initiated in addition to oral prednisolone. After the histopathological confirmation, negative microbial cultures from the middle ear cavities, and the remission of the symptoms by the first recheck, topical, and systemic treatment were discontinued. A follow-up 6 months later, did not reveal any recurrence of the CGs. CLINICAL RELEVANCE: To our knowledge, this is the first case of bilateral CGs diagnosed with a combination of CT, MRI, VO, and histopathology and removed minimal invasively via VO, without a need for ventral bulla osteotomy, which led to complete remission of all signs and no relapse until the follow up 6 months later.

Artificial intelligence to classify ear disease from otoscopy: A systematic review and meta-analysis.

OBJECTIVES: To summarise the accuracy of artificial intelligence (AI) computer vision algorithms to classify ear disease from otoscopy. DESIGN: Systematic review and meta-analysis. METHODS: Using the PRISMA guidelines, nine online databases were searched for articles that used AI computer vision algorithms developed from various methods (convolutional neural networks, artificial neural networks, support vector machines, decision trees and k-nearest neighbours) to classify otoscopic images. Diagnostic classes of interest: normal tympanic membrane, acute otitis media (AOM), otitis media with effusion (OME), chronic otitis media (COM) with or without perforation, cholesteatoma and canal obstruction. MAIN OUTCOME MEASURES: Accuracy to correctly classify otoscopic images compared to otolaryngologists (ground truth). The Quality Assessment of Diagnostic Accuracy Studies Version 2 tool was used to assess the quality of methodology and risk of bias. RESULTS: Thirty-nine articles were included. Algorithms achieved 90.7% (95%CI: 90.1-91.3%) accuracy to difference between normal or abnormal otoscopy images in 14 studies. The most common multiclassification algorithm (3 or more diagnostic classes) achieved 97.6% (95%CI: 97.3-97.9%) accuracy to differentiate between normal, AOM and OME in three studies. AI algorithms outperformed human assessors to classify otoscopy images achieving 93.4% (95%CI: 90.5-96.4%) versus 73.2% (95%CI: 67.9-78.5%) accuracy in three studies. Convolutional neural networks achieved the highest accuracy compared to other classification methods. CONCLUSION: AI can classify ear disease from otoscopy. A concerted effort is required to establish a comprehensive and reliable otoscopy database for algorithm training. An AI-supported otoscopy system may assist health care workers, trainees and primary care practitioners with less otology experience identify ear disease.

Potential of smartphone enabled otoscopy for teleconsultation and teaching.

The smartphone enabled otoscope (SEO) provides an opportunity for telemedicine and enhancing teaching of otoscopy. We describe our preliminary experience with the use of one such inexpensive device bought from an online store. It is a simple and feasible procedure which patients can perform on themselves (or guardians on their wards) after minimal training. The resolution of the image is adequate for follow up through teleconsultation. It is also a good teaching tool as it enables the sharing of views.

Utilisation of a smartphone-enabled video otoscope to train novices in otological examination and procedural skills.

OBJECTIVE: The ai/m of this study was to compare the self-reported confidence of novices in using a smartphone-enabled video otoscope, a microscope and loupes for ear examination and external ear canal procedures. METHOD: Medical students (n = 29) undertook a pre-study questionnaire to ascertain their knowledge of techniques for otoscopy and aural microsuction. Participants underwent teaching on ear anatomy, examination and procedural techniques using a microscope, loupes and smartphone-enabled video otoscopes. Confidence and preference using each modality was rated using a Likert-like questionnaire. RESULTS: After teaching, all modalities demonstrated a significant increase in confidence in ear examination (p < 0.0001). Confidence in using the smartphone-enabled otoscope post-teaching was highest (p = 0.015). Overall, the smartphone-enabled video otoscope was the preferred method in all other parameters assessed including learning anatomy or pathology (51.72 per cent) and learning microsuction (65.51 per cent). CONCLUSION: Smartphone-enabled video otoscopes provide an alternative approach to ear examination and aural microsuction that can be undertaken outside of a traditional clinical setting and can be used by novices.

Otoendoscopes to Enhance Telemedicine During the COVID-19 Pandemic.

OBJECTIVES: As telemedicine has become increasingly utilized during the COVID-19 pandemic, portable otoendoscopy offers a method to perform an ear examination at home. The objective of this pilot study was to assess the quality of otoendoscopic images obtained by non-medical individuals and to determine the effect of a simple training protocol on image quality. METHODS: Non-medical participants were recruited and asked to capture images of the tympanic membrane before and after completion of a training module, as well as complete a survey about their experience using the otoendoscope. Images were de-identified, randomized, and evaluated by 6 otolaryngologists who were blinded as to whether training had been performed prior to the image capture. Images were rated using a 5-point Likert scale. RESULTS: Completion of a training module resulted in a significantly higher percentage of tympanic membrane visible on otoendoscopic images, as well as increased physician confidence in identifying middle ear effusion/infection, cholesteatoma, and deferring an in-person otoscopy (P < .0001). However, even with improved image quality, in most cases, physicians reported that they would not feel comfortable using the images to for diagnosis or to defer an in-person examination. Most participants reported that the otoendoscope was simple to use and that they would feel comfortable paying for the device. CONCLUSIONS: At-home otoendoscopes can offer a sufficient view of the tympanic membrane in select cases. The use of a simple training tool can significantly improve image quality, though often not enough to replace an in-person otoscopic exam.

Face, Content, and Construct Validity of a Virtual Reality Otoscopy Simulator and Applicability to Medical Training.

OBJECTIVE: Otologic diseases are common in all age groups and can significantly impair the function of this important sensory organ. To make a correct diagnosis, the correct handling of the otoscope and a correctly performed examination are essential. A virtual reality simulator could make it easier to teach this difficult-to-teach skill. The aim of this study was to assess the face, content, and construct validity of the novel virtual reality otoscopy simulator and the applicability to otologic training. STUDY DESIGN: Face and content validity was assessed with a questionnaire. Construct validity was assessed in a prospectively designed controlled trial. SETTING: Training for medical students at a tertiary referral center. METHOD: The questionnaire used a 6-point Likert scale. The otoscopy was rated with a modified Objective Structured Assessment of Technical Skills. Time to complete the task and the percentage of the assessed eardrum surface were recorded. RESULTS: The realism of the simulator and the applicability to medical training were assessed across several items. The ratings suggested good face and content validity as well as usefulness and functionality of the simulator. The otolaryngologists significantly outperformed the student group in all categories measured (P < .0001), suggesting construct validity of the simulator. CONCLUSION: In this study, we could demonstrate face, content, and construct validity for a novel high-fidelity virtual reality otoscopy simulator. The results encourage the use of the otoscopy simulator as a complementary tool to traditional teaching methods in a curriculum for medical students.

The reliability of video otoscopy recordings and still images in the asynchronous diagnosis of middle-ear disease.

OBJECTIVE: To compare the asynchronous assessment of video otoscopic still images to recordings by an audiologist and ear, nose and throat surgeon (ENT) for diagnostic reliability and agreement in identifying middle-ear disease. DESIGN: A prospective cross-sectional study, asynchronously assessing video otoscopy, tympanometry and case history (Dx1). A subset was re-diagnosed (Dx2). STUDY SAMPLE: Video otoscopy and data from 146 children recruited at two public community events; a sub-set of 47 were re-assessed. RESULTS: The intra-rater diagnostic agreement between Dx1 and Dx2 was moderate (k = 0.445-0.552) for the ENT surgeon, and almost-perfect (k = 0.928) for the audiologist, in both procedures. The agreement between the two procedures was substantial (k = 0.624) and moderate (k = 0.416) for the ENT surgeon in Dx1 and Dx2 respectively, and almost-perfect for the audiologist (k = 0.854-0.978) in both rounds. In Dx1, the inter-rater agreement between the clinicians was substantial using still images (k = 0.672) and moderate using recordings (k = 0.593); in Dx2 it was moderate using both procedures (k = 0.477-0.488). CONCLUSION: Both video otoscopic procedures, in addition to tympanometry and case history information, can be reliably used for asynchronous diagnosis of childhood middle-ear disease. An audiologist has a potential role in triaging children with middle-ear abnormalities and, therefore, improving access to ear-health services.